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(54) [Title of the Invention] A Skin Imaging and Analysis System and Method Thereof 



(57) [Abstract] 

[Problem] The method and apparatus of this invention 
provides processing that is executed by a human operator 
and an arithmetic unit for the purpose of analyzing and 
displaying images of human skin. 

[Means of Solution] The system obtains digital 
images from a camera or scanner. Next, the system 
determines which region to analyze using guides such as the 
comers of the eye. The region that has been determined is 
analyzed, the positions of defects of the skin such as red 
spots are determined and the defects are identified visually 
on a display. Degree of severity is calculated and 
comparisons are made with the average degree of severity 
in large numbers of people. In addition, simulation is 
performed and improvement in the defective region is 
displayed on a display. 
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[Key is same as Figure 1.] 



♦Translator's Note: Transliterated phonetically from the Japanese. As such, the spelling may differ from oilier transliterations. 
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[Claims] 

[Claim 1] A visual method for determining the 
positions of one or more than one skin defect that is present 
in a part of the human body that is provided with 

a process in which a first digital image of a part of the 
human body is obtained, 

a process in which the aforementioned first digital image of 
a part of the human body is analyzed electronically for the 
purpose of detennining the position of the region that 
contains the skin defect, 

a process in which a second digital image that identifies the 
region that contains the skin defect visually is prepared 
electronically and 

a process that outputs the aforementioned second digital 
image. 

[Claim 2] A method as described in Claim 1 in which 
a further process is provided in which a third digital image 
is prepared electronically in which the region that contains 
the skin defect is improved in simulation by electronically 
converting the colors of multiple pixels inside the region 
containing the skin defect. 

[Claim 3] A method as described in Claim 2 that 
includes the process that displays the first digital image of a 
part of the human body and in which the process that 
displays the first digital image of a part of the human body 
and the process that displays the third digital image in which 
the region that contains the skin defect is improved in 
simulation are repeatedly changed. 

[Claim 4] A method as described in Claim 1 which is 
provided with a process in which a third digital image is 
prepared electronically in which the region containing the 
skin defect is corrupted in simulation and with a process that 
displays the aforementioned third digital image by 
electronically converting the colors of multiple pixels within 
the region that contains the skin defect. 

[Claim 5] A method as described in Claim 1 that is a 
process that displays a first digital image of a part of the 
human body and in which the process that displays the first 
digital image and the process that displays the second digital 
image are repeatedly changed. 

[Claim 6] A method as described in Claim 1 that is 
provided with a process that evaluates the first numerical 
degree of severity in the region containing the defects and 
with a process that makes a comparison of the first 
numerical degree of severity and of a specified value 
corresponding to a population of people. 

[Claim 7] A method as described in Claim 6 in which 
the aforementioned specified value corresponding to a 
population of people is one of a group comprised of (a) a 
value specified by age, (b) a value specified by geography 
and (c) a value specified by race. 



[Claim 8] A method as described in Claim 6 that 
is provided with a process that stores the 
aforementioned first numerical degree of severity 
relating to the region containing the skin defects for the 
purpose of following-up the degree of severity of 
several defects of the skin over time. 

[Claim 9) A method as described in Claim 9 
which is provided with a process that compares the 
aforementioned first numerical degree of severity with 
a second numerical degree of severity and in which the 
aforementioned second degree of severity is the degree 
of severity of defects of the individual after treatment 
of the defects has been performed. 

[Claim 1 0] A method as described in Claim 1 that 
is provided with a process that identifies several marks 
that are in the first digital image of a part of the human 
body and with a process that electronically determines 
a sub-image of the first digital image of a part of an 
individual on the basis of several of the aforementioned 
marks and in which the aforementioned process that 
analyzes the aforementioned first image electronically 
is a process that analyzes only the aforementioned sub- 
image. 

[Claim 11] A method as described in Claim 1 that 
is further provided with a process that determines 
electronically the aforementioned sub-image of the first 
digital image by comparing the color values of several 
colors of several pixels with a specified threshold value 
indicating the color of the skin and in which the 
process that electronically analyzes the aforementioned 
first digital image is a process that analyzes only the 
aforementioned sub-image. 

[Claim 12] A method as described in Claim 1 in 
which the first skin skin defect is constituted of one of 
a group comprise of (a) wrinkles, (b) fine wrinkles, (c) 
blotches, (d) coarse skin, (e) pores, (f) red spots, (g), 
excessively pigmented liver spots and (h) brown liver 
spots. 

[Claim 1 3] A method for visually determining the 
position of skin defects on a part of the human body 
provided with 

a process that acquires a first digital image of a part of 
the human body, 

a process that identifies multiple marks within the first 
digital image of a part of the human body, 

a process that electronically determines a sub-image of 
the first digital image on the basis of multiple marks, 
and 

a process that electronically analyzes the 
aforementioned sub-image of the first digital image for 
the purpose of detennining the position of the region 
that contains the skin defect. 
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[Claim 14] A method as described in Claim 13 that is 
further provided with a process that electronically makes a 
second digital image in which the region containing the skin 
defect is improved in simulation and with a process that 
displays the aforementioned second digital image. 

(Claim 15] A method as described in Claim 13 that is 
provided with a process that prepares a second digital image 
in which the region containing the skin defect is worsened in 
simulation and with a process that displays the 
aforementioned second digital image. 

[Claim 16] A method as described in Claim 13 that is 
provided with a second digital image that determines the 
numerical severity of the region that contains the skin defect 
and with a process that makes a comparison of the numerical 
severity with a specified value corresponding to a population 
of people. 

[Claim 17] A method as described in Claim 13 that is 
further provided with a process that electronically makes a 
second digital image that visually identifies the region 
containing the skin defect and with a process that displays 
the aforementioned first digital image. 

[Claim 18] A method for visually determining the 
positions of multiple skin defects associated with the human 
face that is provided with 

a process that electronically analyzes the first digital image 
of the human race for the purpose of determining the 
positions of regions of multiple defects in which the various 
defect regions contain visual skin defects and which have 
sizes of approximately less than 10% of the size of the first 
digital image, 

a process for electronically making a second digital image on 
the basis of the first digital image and the defect regions of 
the human face in which the second digital image visually 
identifies multiple defect regions that are within the first 
digital image by electronically converting the colors of 
multiple pixels that are essentially present in the region 
containing the skin defects to at least one color that can be 
differentiated visually from the color of the skin within the 
first digital image. 

[Claim 19] A method as described in Claim 18 in 
which a third digital image that has one improved region for 
each of the multiple defect regions and in which these 
improved regions are made by electronically converting the 
colors of multiple pixels that are contained in one of the 
multiple defect regions and which method is provided with a 
process that electronically makes the third digital image on 
the basis of the first digital image and the positions of the 
defect regions and with a process that displays the 
aforementioned third digital image. 

[Claim 20] A method as described in Claim 19 that is 
further provided with a process that displays the first digital 
image of the human face, and, in which, for the purpose of 
increasing the degree of human apprehension of the 
simulated improvement, the process that displays the 



aforementioned first digital image and the process that 
displays the aforementioned third digital image are 
repeatedly changed. 

[Claim 21] A method as described in Claim 18 
that is further provided with a process that displays the 
first digital image of the human face, and, in which, for 
the purpose of increasing the degree of human 
apprehension of the positions of the multiple defect 
regions, the process that displays the aforementioned 
first digital image and the process that displays the 
aforementioned second digital image are repeatedly 
changed. 

[Claim 22] A method as described in Claim 18 
that is provided with a process that evaluates the first 
numerical severity relating to the multiple defect 
regions that are within the first digital image of the 
human face and with a process that produces a 
comparison of the first numerical severity with a 
specified value corresponding to a population of 
people. 

[Claim 23] A method as described in Claim 18 
that is provided with a process that identifies multiple 
marks in the shape of the first digital image of the 
human face and with a process that determines sub- 
images of the aforementioned first digital image of the 
human face and in which the process that analyzes the 
aforementioned first digital image of the human face is 
a process that analyzes only the aforementioned sub- 
images. 

[Claim 24] A method as described in Claim 18 
that, for the purpose of evaluating all of the 
characteristics of the skin related to digital images of 
the human skin, is provided with a process that 
electronically analyzes the first digital image of the 
human face. 

[Claim 25] A method for determining the 
positions of visual multiple skin defects associated 
with the human face that is provided with 

a process that selects at least one mark from a group 
comprised of (a) the corners of the eyes within the first 
digital image, (b) the corner of the nose within the first 
digital image and (c) the comers of the mouth within 
the first digital image and that identifies the first 
multiple marks that are in the first digital image shape 
of the human face, 

a process that electronically analyzes sub-images of the 
aforementioned first digital image of the human face on 
the basis of the first multiple marks and 

a process that electronically analyzes the sub-images 
of the first digital image of the human face for the 
purpose of determining the positions of multiple defect 
regions in which the various defect regions contain 
visual skin defects and that have a size of 
approximately less than 10% of the size of the first 
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digital image of the human face. 

[Claim 26] A method as described in Claim 25 is 
provided with a process in which the cursor is displayed on 
various marks of the second multiple marks on a display unit 
and that identifies the first multiple marks that are within the 
first digital image of the human face and with a process that 
selects the position of the first multiple marks by operating 
an input unit. 

[Claim 27] A method as described in Claim 25 in 
which the process in which the cursor is displayed on various 
marks of the second multiple marks on a display unit, in 
which the second multiple marks are a partial aggregation of 
the first multiple marks and that identifies the first multiple 
marks that are within the first digital image of the human 
face and that is provided with a process that selects the 
position of the second multiple marks by operating an input 
unit and with a process in which the third multiple marks are 
partial aggregates of the first multiple marks and that 
determines the position of the third multiple marks on the 
basis of the second multiple marks and of a specified 
template of standard marks. 

[Claim 28] A method as described in Claim 25 in 
which the process that identifies the first multiple marks that 
are within the first digital image of the human face is 
provided with a process that electronically detects the 
position of at least one mark among the first multiple marks. 

[Claim 29] A method as described in Claim 25 that is 
provided with a process that makes a second digital image on 
the basis of the first digital image of the human face and of 
the position of the defect region and with a process that 
displays the aforementioned second digital image on a 
display, in which the color of multiple pixels that are 
essentially present in the region of the second digital image 
that contains the skin defect is replaced electronically by at 
least one color that can be differentiated visually from the 
color of the skin of the first digital image, by which means 
the multiple defects region that is positioned within the first 
digital image of the human face is visually identified. 

[Claim 30] A method that is described in Claim 25 that 
is further provided with a process that determines the first 
numerical severity related to the multiple defect region within 
the first digital image of the human face and with a process 
that produces a comparison of the first numerical severity 
with a specified value associated with a population of 
people. 

[Claim 31] A method for improving visual multiple 
skin defects in terms of simulation associated with the human 
face that is provided with 

a process in which the first image has a size and that obtains 
a first image of the human face, 

a process that electronically analyzes the first digital image 
of the human face for the purpose of evaluating the position 
of the multiple defects region in which each defects region 
has visual skin defects and a size of less than 10% of the size 



of the first image, 

a process that electronically makes a second digital 
image on the basis of the first digital image of the 
human face and of the position of the defect region in 
which the second digital image is made by 
electronically converting the color of multiple pixels 
contained in one of either the region in which the 
respective multiple defect regions are improved or of 
the multiple defect region that is within the first digital 
image of the human face and 

a process that displays the second digital image on a 
display. 

[Claim 32] A method as described in Claim 3 1 
that is provided with a process that electronically 
analyzes the first digital image of the human face for 
the purpose of evaluating all of the characteristics of 
the skin relating to the digital image of the human face. 

[Claim 33] A unit that evaluates the positions of 
multiple visual skin defects relating to the human face 
that is provided with a digital image generator that 
produces a first digital image of the human face, which 
first digital image has the color of skin, a display unit 
that is connected with the display image generator so 
that they interlock for the purpose of producing visual 
displays of the human face on the basis of the first 
digital image of the human face that is produced by the 
aforementioned digital image generator and a controller 
that is connected so that the aforementioned digital 
image generator and the aforementioned display unit 
are interlocked, that produces a visual display of the 
human face in the aforementioned display unit when 
the first digital image is received from the 
aforementioned digital image generator, that analyzes 
the first digital image for the purpose of evaluating the 
group of coordinates that display multiple positions of 
multiple skin defects that are actually present, that 
visually identifies multiple defect regions that are 
within the digital image by electronically converting 
the color of multiple pixels that are essentially present 
in the region of the second digital image containing the 
skin defects, that makes a second digital image on the 
basis of the first visual image and coordinates and that 
displays the second digital image on the 
aforementioned display unit. 

[Claim 34] A method as described in Claim 33 
that is further provided with a position deterrnining 
unit that determines the position of the human face and 
in which the aforementioned digital display generator 
is installed so that it has a specified distance and angle 
relative to the aforementioned position determining 
unit. 

[Claim 35] A unit for evaluating the position of 
visual skin defects involving the human face that is 
provided with a digital image generator that produces 
a first digital image of the human face, which digital 
image has the color of skin, 
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a display unit that is connected so that it interlocks with the 
aforementioned digital image generator for the purpose of 
producing a visual display of the human face on the basis of 
the first digital image of the human face that is produced by 
the aforementioned digital image generator, 

an input unit that is connected so that it interlocks with the 
aforementioned display unit so that the user can designate the 
first multiple marks that is on the visual display of the 
human face that is produced by the aforementioned display 
unit and 

a controller that is connected so that it interlocks with the 
aforementioned digital image generator, that produces a 
visual display of the human face in the aforementioned 
digital unit when the first digital image is received from the 
aforementioned digital image generator, that evaluates the 
second multiple marks that are in the aforementioned first 
digital image on the basis of the aforementioned first 
multiple marks in response to operation of the 
aforementioned input unit, that determines sub-images of the 
aforementioned first digital image on the basis of the first 
multiple marks and the second multiple marks and that 
analyzes the aforementioned sub-images for the purpose of 
evaluating the group of coordinates that indicates multiple 
positions of multiple skin defects that are actually present. 

[Claim 36J A unit as described in Claim 35 in which 
multiple defect regions in the second digital image are 
identified visually by electronically converting the colors of 
multiple pixels that are essentially present in the region 
containing skin defects to at least one color that can be 
visually differentiated from the color of the skin of the first 
digital image and in which the aforementioned controller 
makes the first digital image and the second digital image on 
the basis of a group of coordinates and further displays the 
second digital image in the aforementioned display unit. 

[Claim 37) A unit as described in Claim 35 that is 
further provided with a position determining unit for the 
purpose of detenriining the position of the human face and in 
which the aforementioned digital image generator is installed 
so that it has a specified distance and angle relative to the 
aforementioned position determining unit. 

[Claim 38] A unit for the purpose of improving, from 
a simulation standpoint, multiple visual defects of the skin 
involving the human face that is provided with a digital 
image generator that produces a first digital image of the 
human face, 

a display unit that is connected so that it interlocks with the 
aforementioned digital image generator and that produces a 
visual display of the human face on the basis of the first 
digital image of the human face that is produced by the 
aforementioned digital image generator and 

a controller that is connected so that it is interlocked with the 
aforementioned digital generator and the aforementioned 
display unit, that produces a visual display of the human 



face in the aforementioned display unit when the first 
digital image is received from the aforementioned 
digital image generator, that analyzes the 
aforementioned first digital image for the purpose of 
evaluating the group of coordinates that indicates the 
multiple positions of the multiple skin defects that are 
actually present, that produces a second digital image 
on the basis of the aforementioned first digital image 
and of the group of coordinates, in which case the 
second digital image is an image in which the multiple 
defects that are in the first digital image have been 
improved in terms of simulation by changing the colors 
of multiple pixels that are contained in the respective 
multiple defect regions, and that displays the 
aforementioned second digital image in the 
aforementioned display unit. 

[Claim 39] A unit as described in Claim 38 that 
is provided with a position determining unit for the 
purpose of determining the position of the human face 
and in which the aforementioned digital image 
generator is installed so that it has a specified distance 
and angle with the aforementioned position deterrnining 
unit. 

[Claim 40] A recording medium that records 
program directions that is provided with a unit that 
acquires a first digital image of a part of the human 
body, 

a unit that electronically analyzes the first digital image 
of a portion of the human body for the purpose of 
evaluating the position of the region that contains skin 
defects, 

a unit that electronically prepares the second digital 
image that visually identifies the region that contains 
the skin defect and 

a unit that outputs a second digital image. 

[Claim 41] A method that characterizes human 
skin that is provided with 

a process that acquires a first digital image of the 
human face, 

a process that electronically determines sub-images of 
the first digital image of the human face, 

a process that electronically analyzes the first digital 
image of the human race for the purpose of evaluating 
all of the characteristics of skin relating to the digital 
images of the human face, 

a process that evaluates comparisons of all of the 
characteristics of the skin and specified values relating 
to a population of people, 

a process that produces a second digital image on the 
basis of the comparison of all of the characteristics of 
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the skin and of specified values and 

a process that displays the aforementioned second digital 
image on the display. 

[Detailed Description of the Invention] 
[0001] 

[Technological field of the invention] This invention, 
in general, relates to a unit and a method for displaying 
information concerning skin defects. In particular, it relates 
to a unit and a method for evaluating and displaying one or 
more than 1 region of analysis or region of defect involving 
digital images of human skin, and, further, for displaying 
improvement or worsening of defect regions. 

[0002] 

[Prior art] Almost everyone in the world uses cosmetic 
products or skin care treatments with the intention of 
improving their physical appearance. There is a wide range 
of selection for consumers in selecting useful products. In 
almost all cases, it is difficult for individual consumers to 
evaluate what type of product and use will bring about the 
greatest improvement for their type of skin and its condition. 
This problem is linked to changes in skin conditions among 
individuals over time and is complicated by the fact that it is 
also linked to changes in social standards over time. 

[0003] Beauty counselors at retail cosmetic products 
counters assume the responsibility of perceiving the skin 
defects of consumers. Once a skin defect has been specified, 
the counselor must inform the customer of the type of defect' 
its size and its position. Finally, the counselor must 
recommend a product for the purpose of improving the skin 
defect and a method for its use. 

[0004] 

[Problems the invention is intended to solve] In 

almost all cases, the advice described above is subjective and 
not all beauty counselors can specify the same type or 
number of skin defects. The results of counsel will vary 
among counselors and customers when customers visit. In 
almost all cases, it is difficult for the counselor to describe 
the defects that are seen to the customer and the trial-and- 
error method of recommending and conducting trials takes 
time and is tedious. 

[0005] 

[Means for solving the problems] This invention 
relates to a method and a unit for analyzing multiple skin 
defects that can be seen with the eyes. This invention relates 
to a method and a unit whereby skin defects are specified 
immediately in a user-friendly form, whereby the operator 
can recommend cosmetic products and medicinal drug 
products and whereby tests can be made to determine 
whether defect regions are improving or worsening. 

[0006] One characteristic of this invention is that the 
system of this invention can specify the positions of multiple 
skin defects that can be seen with the eyes on the human 
face. The system of this invention obtains a first digital 



image of the human face, analyzes it and locates 
regions of multiple defects. In almost all cases, all of 
the defect regions are considerably smaller than the 
first digital image and each defect region contains at 
least one skin defect that can be seen with the eyes. 
Next, the system electronically makes and displays a 
second digital image that displays the individuals face 
and defect regions on the basis of the first digital 
image. The second digital image visually specifies 
regions of multiple defects that are contained in the 
first digital image by electronically changing the colors 
of multiple pixels of the region containing the skin 
defects (i.e., the region itself or its perimeters) 
essentially to at least one color that can be 
distinguished from the color of the skin in the first 
digital image. 

[0007] Another characteristic of this invention is 
that the system of this invention specifies the positions 
of multiple defects on the human face that can be seen 
with the eyes. The system of this invention obtains a 
first image of the individual's face and specifies marks 
that are contained in the first image of the individual's 
face, for example, the corners of the eyes, the corners 
of the nose or the corners of the mouth. Next, the 
system electronically determines sub-images from the 
first image of the individual's face on the basis of the 
various multiple marks. It then electronically analyzes 
this sub-image and specifies the position of the region 
of multiple defects. In almost all cases, each defect 
region is considerably smaller than the first digital 
image and each defect region contains at least one 
defect of the skin that can be seen with the eyes. 

[0008] Another characteristic of this invention is 
that the system of this invention can evaluate whether 
the multiple skin defects of the individual's face that 
can be seen with the eyes are improved or have 
worsened. This system obtains a first image of the 
individual's face, electronically analyzes the first image 
of the individual's face and specifies a region of 
multiple defects. In almost all cases, each defect 
region is considerably smaller than the first image and 
each defect regions contains at least 1 defect that can 
be seen with the eyes. Next the system electronically 
makes and displays a second digital image on the basis 
of the first digital image of the individual's face and the 
position of the defect. The second digital image 
contains regions that are improved (or are worsened) 
relative to each of the multiple defect regions. Each 
region is improved (or is worsened) by electronically 
changing the colors of multiple pixels in one of the 
regions among the regions of multiple defects that are 
contained in the first digital image of the individual's 
face. 

[0009] When the detailed explanation of a 
desirable mode of execution of this invention is seen by 
reference to the figures, its characteristics and superior 
points as described above should be evident to those 
who have a general knowledge of the field of 
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technology to which this invention pertains. Brief 
explanations of the figures are presented in the latter part of 
the specification. 

[0010] 

[Mode of execution of the invention] Figure 1 is a 
block diagram that shows the imaging unit whereby this 
invention is realized. In order to analyze cosmetic products 
and skin care products and to make recommendations to 
customers, the imaging unit is installed at the cosmetic 
products counter of a retail shop. However, if an individual 
has common knowledge in the field of technology pertaining 
to this invention, it can be recognized immediately that the 
unit of this invention can otherwise be applied without 
departing from the concept of this invention. For example, 
the unit of this invention can be used in the field of medicine 
for medical examinations and for storing the results of 
medical examinations. In order for the unit of this invention 
to obtain images of human skin for analysis, it is provided 
with the imaging unit (imaging rig) 104, which is connected 
to the arithmetic unit 106. Here, in order to simplify the 
explanation and maintain consistency, imaging of the skin of 
the human face will be explained. However, if an individual 
has common knowledge of the field of technology pertaining 
to this invention, it will be immediately acknowledged that 
other parts of the body (for example, hands, arms and feet) 
can also be imaged. 

[0011] The imaging unit 104 is provided with the 
position unit 116, the light 118 and the digital image 
generator 120. The digital image generator 120 may be, for 
example, a digital camera, an analog camera that is 
connected to a digital conversion circuit, a scanner or a video 
camera. The various units that constitute the imaging unit 
104 are installed at specified distances from each other and 
at specified angles for the purpose of optimizing the images 
that are obtained. For example, the positioning unit 1 16, 
which is for the purpose of stabilizing the face of the 
individual, is a unit that is used so that the image contains at 
least chin space or forehead space. The digital image 
generator 120 is installed so that it is at a specified distance 
and a specified angle relative to the positioning unit 116. 

[0012) The arithmetic unit 106, for example, is 
connected to one or more than one output units such as the 
first display 108 and the second display 114 and/or the 
printer 112. Cathode ray tubes (CRT), liquid crystal 
displays (LCD) or displays of other forms may be used as 
the displays 108 and 114. A laser printer, an ink jet printer 
or a printer of another form may be used as the printer. The 
displays 108 and 114 display digital images of skin 
preferences, skin selection and skin that the operator reads. 
The printer 1 12, which is connected optionally, can be used 
to print digital images and results of analysis for the person 
who is performing the analysis. 

[0013] Figure 2 is a diagram that shows the arithmetic 
unit 1 06 in greater detail . The arithmetic unit 1 06 may be an 
ordinary computer in which a program for executing the 
method and/or units of this invention is incorporated. 
Further, the arithmetic unit 106, as should be evident to 



those having common knowledge in the field of 
technology pertaining to this invention, may be an 
application specific unit with which the method and/or 
unit of this invention can be executed. The controller 
200 of the arithmetic unit 1 06 is provided with the data 
memory 202 such as, for example, a random access 
memory and/or disk drive, the program memory 204 
such as, for example, read-on memory (ROM), and the 
microprocessor 206, which are connected by the data 
base 208. The program memory 204 electronically 
stores a computer program that executes all or a part 
of the method of this invention as described below and 
the program is executed by the microprocessor 206. 
The program memory 204 may be loaded, for example, 
from a fixed memory such as a hard drive or it may be 
loaded in advance in firmware that is known to those 
in the industry. The various processes that are 
described subsequently can be performed manually or 
without using the arithmetic unit 106. 

[0014] The input-output (I/O) circuit 210 is an 
ordinary sender-transmitter. For example, it may be 
constructed of a modem. Typically, the controller 200 
is connected to a communication channel such as the 
optional network 222 (for example, a local area 
network or the internet). The network 222 can be used 
for the purpose of obtaining digital images and/or other 
information that can be used in processing as described 
subsequently. For example, the input unit 2 1 2, such as 
a keyboard and/or switch, is connected to the I/O 
circuit via the line 214, data is input into the controller 
200 and a command can be sent. Further, the displays 
108 and 1 14 may be connected to the I/O circuit 210, 
and, for the purpose of visually displaying the data that 
are produced by the processing of the arithmetic unit 
106, the data can be received via the line 218. 

[0015] Synopsis of processing by this invention 
Figure 3 is a flow chart that shows the processing 
300 that is based on the concept of this invention and 
that is executed by the operator and the arithmetic unit 
106 for the purpose of analyzing and displaying the 
images. Here, the processing, which has been 
programmed by the arithmetic unit 1 06, is executed by 
the controller 200. When the processing 300 is begun, 
the controller 200 obtains images (step 302) and the 
regions inside the image are analyzed or evaluated (i.e., 
sub-images are deterrnined) (step 304). These regions 
are analyzed and the positions of defects are specified 
(step 306) and the severity of the defect is compared 
with the average severity of the skin of a population of 
people and with other statistical parameters (step 306). 
The results of analysis are then displayed (step 308) 
and the regions of defects are improved or worsened in 
simulation (step 310). These steps are explained in 
detail below. 

[0016] Obtaining of images 

Figure 4 is a flow chart that is based on the 
concept of this invention and that shows in detail the 
content of the processing 302 (see Figure 3). 
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Here, each processing is performed by the operator and the 
controller 200. The processing 302 begins from step 402 in 
which a part of the person (for example, the face) that the 
operator is to analyze is designated inside the image unit 
104. In order to obtain an ideal image, sufficient and 
consistent irradiation of light is necessary. In steps 404 and 
406, in order to optimize image quality, the position of the 
human race is determined, after which positioning of the light 
1 18 and of the digital image generator 120 (for example, a 
camera) is effected. In order to accelerate processing for 
obtaining images, the position of the light 118 and of the 
image producing unit 120 may be determined before 
determining the position of the face. 

[0017J After the positions of the light 1 18, the digital 
image generator 120 and the face have been determined, in 
step 4 1 0, a photograph is taken in response to the command 
of the operator. The photograph is digitalized by a known 
method in step 410 (i.e., it is converted to binary numeral 
representation). In the final step, 4 12, the digital image data 
are sent to the arithmetic unit 106. There are many other 
methods of obtaining digital images and these methods are 
self-evident to those in the industry. For example, the 
individual who is performing the analysis introduces a 
photograph through the network 222 and the file is found 
from the data base. And/or a plane scanner may be used to 
digitalize an analog photograph. 

[0018] Graphical user interface 

Figure 5 is a diagram that is based on the concept of 
this invention and that shows line writing of a graphical user 
interface that is executed by the arithmetic unit 106 and the 
display unit 108 for the purpose of displaying the image. 
The information that is produced by the first display unit 1 08 
can also be produced by the second display unit 1 14 and/or 
can be printed by the printer 112. The graphical user 
interface shown in Figure 5 is provided with the tab bar 502, 
which is installed along the top of the display 108. The 
operator control unit 503 is installed along the left side of the 
display 1 08 . The image of the human face 5 1 8 that has been 
obtained is displayed in the center of the display. If one has 
common knowledge in the field of technology pertaining to 
this invention, modified examples such as user interface units 
will immediately be recognized. 

[0019] Display of the various forms that are produced 
by the display unit 1 08 can be transformed selectively within 
the tab bar 502. In particular, in this example, the selection 
tab is effective for photograph taking 504. Further, it is also 
convenient for displaying the results of comparison 506, for 
displaying one or more than 1 skin defect (508-5 14) and for 
displaying the results of simulations 516 that have been 
improved or worsened. When the operator or the individual 
performing the analysis selects a tab in the tab bar by a 
known method using the input unit 212, a display 
corresponding to it is produced, These displays are shown 
in Figure 7, Figures 10 to 14 and Figure 16. This will be 
explained in detail below. 

[0020] The operator and/or the individual performing 
analysis inputs data using the input unit 2 1 2 and the operator 



controls unit, the preference is selected and a command 
is made for operation to the arithmetic unit 106 In 
this example, the text box 520 is effective for inputting 
the name of the person. The name of the person can be 
used as an identifier for a subsequent visit when 
accessing examination data that was analyzed the 
previous time from the memory 202. The age of the 
person is input in the text box 522. In a case such as 
this, the age of the person is effective when the results 
of analysis are used at times when restrictions are 
applied and when comparing averages for populations 
(or other statistical parameters). 

[0021] Other operator control units are the 
"photograph" button 524, the "mask" button 526, the 
slide control 528, the preference check box 530 and the 
"analysis" button 532. The photograph button 524 
starts the computer control component that performs 
image collection processing as described above (see 
Step 408 in figure 4). The mask button 526 initiates 
evaluation of the sub-images (see Step 304 in Figure 3 
and Figure 6). The slide control 528 controls the size 
of one or more than one sub-image (details to be 
discussed subsequently). The preference check box 
520 determines which characteristic of the skin (for 
example, texture, wrinkles, pores and/or liver spots) 
are to be analyzed and also determines whether or not 
comparison with average skin (for example, 
comparison with an average member of any group of 
persons) is to be performed. The analysis button 532 
initiates analysis processing (see step 306 in Figure 3 
and Figure 8). 

[0022] Determination of sub-images 

Figure 6 is a flow chart that shows the detailed 
content of the processing 304 (see Figure 3) based on 
the concept of this invention. Determination of sub- 
units by the arithmetic unit 106 is the processing that 
is executed. In this mode of execution (in one 
embodiment), each processing step is performed by the 
controller 200. The sub-images are a part of the 
obtained image 518 which is being processed. In 
analysis processing, generation of errors can be 
controlled by cutting out a portion of the obtained 
image 518. For example, by removing the eyes and 
nose from the object of analysis processing, making an 
erroneous evaluation that there is a component of the 
skin in which there has been a great color change can 
be controlled. (See sub-image contour 704 in Figure 
7.) In the following text, we will explain 4 methods for 
deterrnining the contours of sub-images. However, for 
someone who has common knowledge of the field of 
technology pertaining to this invention, other methods 
based on combinations of these four methods can 
immediately be discerned. 

[0023] In step 602, in which the processing 304 
is begun, it is ascertained whether determination of the 
sub-images is to be performed automatically or to be 
performed manually. Here, the operator determines the 
sub-image using the input unit 2 1 2. As another mode 
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selection of the sub-image may be performed in the controller 
200. In this case, the controller 200 automatically analyzes 
all or a part of the image. Then, on the basis of the results 
of the analysis, it is determined by the controller 200 to 
perform determination of the sub-images either automatically 
or manually. For example, there are results that show a level 
at which automatic determination of sub-images can be 
trusted (for example, when the nose can be discerned 
precisely to a certain extent). In the case in which the results 
are below a specified threshold value at which there are 
results that can be trusted, the controller 200 selects 
determination of sub-images by manual means. 

(0024] When manual determination of sub-images is 
selected, determination of sub-images by either high-speed 
processing or low-speed processing is selected in step 606. 
This selection is performed by the operator using the input 
unit 212. When low-speed processing is selected, in step 
622, the operator draws the contour 704 (see Figure 7) of the 
sub-image by a known method using the input unit 212 and 
the displayed image. When high-speed processing has been 
selected, the controller 200 selects a series of marks 702 that 
are displayed on the image 518 for the operator. (For 
example, the corners of the eyes, the corners of the nose and 
the corners of the mouth are selected in sequence.) In step 
620, the operator selects, by a known method, the various 
marks 702 (see Figure 7) for the sub-image using the input 
unit 212 and the displayed image 518. Next, the controller 
200 draws the contour 704 of the sub-image by a known 
method while connecting the marks 702. 

[0025] When automatic selection of sub-images is 
effected, in step 604, either totally automatic or semi- 
automatic determination is selected. This selection is 
performed by the operator using the input unit 212. When 
semi-automatic selection of the sub-image is selected, in step 
612, the operator selects a series of marks 702 for the sub- 
image by a known method using the input unit 212. 
However, at this time, there is no necessity for the operator 
to select all of the marks 702. In steps 614 and 616, the 
controller 200 compares the marks 70 1 that the operator has 
input with a specified marks template (for example, a 
standard mask) and the remaining marks 702 are 
automatically determined by changing the marks 702 that the 
operator has input using known line-drawing algorithm 
(shape warping algorithm). For example, the remaining 
marks 702 may be calculated by using spatially different 
vectors (delta x, delta y) between the various marks 702 that 
the operator has input and the respective standard marks 
corresponding to these marks 702. Then, the remaining 
marks 702 are determined by using secondary curve 
interpolation of the spatially different vectors and the two 
coordinates x and y of the marks 702 that have been input by 
the operator. Next, the controller 200 draws the contour 704 
of the sub-image by connecting the marks 702 (both the 
marks 702 that have been input by the operator and the 
marks 7021 that have been automatically determined) by a 
known method. 

[0026] When totally automatic selection of the sub- 
image is selected, in step 608, the controller 200 determines 



all of the marks 702 for the sub-image by retrieving the 
pattern showing the specified marks within the digital 
image 518. Algorithms that differentiate the 
characteristics of many faces are self-evident to those 
with ordinary knowledge in the field of technology 
pertaining to this invention. One algorithm of this kind 
is described in detail in "Lip Features Automatic 
Extraction: by M. Lievin and F. Luthon in Proceedings 
of the 1998 IEEE International Conference on Image 
Processing, WA05.03, Chicago, October 1998. This 
paper is noted as a reference paper. 

[0027] Once- the principal sub-image is 
determined, in step 618, additional sub-images are 
determined. Here, a curve is drawn between two 
marks 702 by the controller and the contour 706 of the 
sub-image below the eye (see Figure 7) is determined. 
In step 624, the operator adjusts the size of the sub- 
image below the eye by operating the slide control 528. 
For example, when the slide control 528 is moved to 
the right, tie arc of the contour of the sub-image below 
the eye is increased, and, when the slide control 528 is 
moved to the left, the arc of the sub-image below the 
eye is decreased. Further, even if one or more than one 
of the steps described above is not executed, in step 
626, the controller draws the contours of all of the sub- 
images. 

[0028] As another mode, sub-images can be 
electronically determined by comparing the color 
values of multiple colors of multiple pixels with a 
specified threshold value indicating the color of skin. 
This known technology is described in detail in 
"Detecting Human Faces in Color Images" by M.H. 
Yang and N. Ahuja in Proceedings of the 1998 IEEE 
International Conference on Image Processing, 
WA05.02, Chicago, October 1998. This paper is 
noted as a reference paper. This technology is also 
described in detail in " Detecting Human Faces in 
Color Images" by R. Herpers, G. Verghese et al., in 
Proceedings of the Second International Conference on 
Audio and Video-Based Person Authentication 
(AVBP A99), Washington, DC, 3/23-3/24, 1 999. They 
are also noted as reference papers. 

[0029] Analysis of sub-images 

Once sub-images have been determined, these 
sub-images are analyzed. Figure 8 is a flow chart that 
shows the detailed content of the processing 306 (see 
Figure 3) that is executed by the arithmetic unit 1 06 on 
the basis of the concept of this invention. It shows the 
content in which the sub-images are analyzed, the 
positions of defects are determined and the severity of 
the defects is compared with the average severity of the 
skin of a population of people. Here, each processing 
step is executed by the controller 200. The regions of 
defect within a sub-image is a defect that satisfies a 
certain standard (for example, red spots). The severity 
of defects in a specific case is an estimation of the 
standard for recognizing one defect as being worse 
than another defect. For example, it is thought that a 
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large red spot is of greater severity than a small red spot. 
Many different types of defects are present. For example, 
there are wrinkles and/or fine lines, which are characteristics 
that indicate the elasticity of the skin. The positions of 
defects of skin smoothness, skin texture, follicular pores, red 
spots in which inflammation has developed such as, for 
example, pimples, liver spots in which there is excess 
pigment such as, for example, senile Ientigenes, nevi, 
freckles and many other defects can be specified by using 
algorithms. Examples of these algorithms are presented in 
detail in Skin Surface Analysis System and Skin Surface 
Analysis Method (Japanese Patent Document 95-231883), 
Systems and Methods for the Multispectral Imaging and' 
Characterization of Skin Tissue (PCT Document WO 
98/37811) and Apparatus and Method for Monitoring 
Visually Accessible Surfaces of the Body (U.S. Patent 
Document 5,0 1 6, 1 73) . These papers are noted as reference 
papers. 

[0030] The processing 306 begins from processing step 
802 in which the index variable is set to zero. The objective 
of using the index variable is for determining whether all 
types of defects are to be analyzed. When only one type of 
defect is to be analyzed, the index value is eliminated. In 
processing step 804, the positions of multiple regions that 
contain existing defects in the sub-image are specified. For 
example, when the sub-image contains six red liver spots (as 
determined by a known algorithm for detecting red liver 
spots), the positions of the six liver spots in the sub-image 
are specified. The position of each liver spot is specified by 
specifying the approximate center of the defect using a pair 
of geometric coordinates. In addition, the position of each 
liver spot may also be specified by using a pair of 
geographic coordinates that are determined by type of 
existing defect. 

[0031] In step 806, the controller 200 makes a new 
digital image on the basis of the original digital image of the 
person's face and on the position of the defect region (see 
Figure 1 1 to Figure 14). A region of multiple defects within 
the original digital image can be recognized visually by the 
user by electronically changing the colors of multiple pixels 
essentially within the region containing the skin defects (i.e., 
the defect region or its perimeter) to at least one color in the 
new digital image that can be differentiated visually from the 
skin color in the first digital image. For example, the skin 
colors of the various colors within the defect region may be 
changed to a blue color to make a transparent umbrella 
coating. As another example, green circles may be drawn in 
the perimeters of six red liver spots so that the positions of 
the six liver spots can be recognized visually. 

[0032] In step 808, the controller 200 evaluates the 
numerical severity of the defect region. Here, the content of 
the color associated with the defect region is obtained by 
subtracting the color of the perimeter of the defect region 
from the content of the color of the defect region. For 
example, the pixels that are used to represent the red spots 
have a 60% content of red color and the pixels that represent 
the color of the skin on their perimeters have a 1 0% content 
of red color. At this time, the numerical severity relevant to 



the red spot defects is determined to be 50. As another 
mode, the number of geographical coordinates 
necessary to cover the defect region may be taken as 
the numerical severity. For example, when a pore that 
has been detected covers 30 pixels, the numerical 
severity of that pore may be determined to be 30. 
When a certain type of defect is comprised of many 
elements, the severity may be aggregated. For 
example, in a case of this sort, the severity may be 
totaled or averaged. 

[0033] In step 8 1 0, the controller 200 normalizes 
the aggregated severity on the basis of the perception 
coefficients of the person. For example, when it has 
been ascertained in clinical research that red spots 
require twice the attention of brown spots, the 
aggregated severity involved in the analysis of red 
spots may be doubled. Further, instead of doing this, 
the severity of gray spots may be halved. Of course,' 
those having ordinary knowledge in the field of 
technology pertaining to this invention will 
immediately recognize the fact that two or more types 
of defect can be normalized. 

[0034] In step 812, the controller determines the 
percentile of normalized severity using data relating to 
a certain fixed population of people. The data on the 
population may be specified by the age of the 
individuals to be analyzed, their geographical location, 
their racial lineage or other elements. For example' 
when 55% of the individuals of a sample group of 
individuals that are analyzed in an age group have a 
normalized severity that is lower than the severity of 
the individuals that have been analyzed for the type of 
defect that is present and 45% of the individuals of the 
sample group have a severity higher than the severity 
of the individuals who have been analyzed, the 
percentile is evaluated as 55 to 56. 

[0035] In step 8 14, the controller 200 increments 
the index variable, and, in step 8 16, the controller 200 
diagnoses whether many types of defects that should be 
processed are present. When many types of defect are 
present, processing returns to step 804 and processing 
is repeated. The loop from steps 804 to 816 is 
repeated and the controller 200 prepares a new image 
that identifies the defect region using a different 
algorithm for the position of the defects. Different 
index variables may be used in normalization and 
different population data may be used when 
detemiining the percentile. (See Figures 10 to 14.) 

[0036] When a type of defect that is being 
processed is not present, the controller 200, in step 8 1 8 
and step 820, calculates the severity of the skin as a 
whole and the percentile of the skin as a whole, 
respectively. The severity of the skin as a whole is an 
aggregate of the severity of individual defects of the 
skin. For example, in step 808, the multiple severity 
that was repeatedly determined may be averaged. The 
percentile of the skin as a whole is calculated using a 
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different group of data that represents the severity of the skin 
as a whole of a population of individuals so that it is the 
percentile of individual defects of the skin as described 
above. Further, the data on the individuals that are analyzed 
are selected on the basis of the population statistics of the 
individuals that have been analyzed. 

[0037] In addition to overall severity on the basis of 
aggregation of defect severity of the skins of individuals, one 
or more than one characteristic of the skin is evaluated on an 
overall basis. This overall characteristic of the skin is not 
dependent on individual defects of the skin. For example, the 
degree of smoothness/roughness of the skin as a whole is 
evaluated. In this type of evaluation (for example, when the 
entire image or a sub-image is analyzed), a fixed skin defect 
may be included or (for example, when a defect region in 
which there is severe pigment deposition is not analyzed) a 
fixed defect may be excluded. 

[0038] The various methods for evaluating the severity 
of the skin as a whole will be known to those having a usual 
knowledge of the field of technology that pertains to this 
invention. Surface region density is a determination of total 
surface area that has been partitioned by pixel counts. When 
the digital image is considered to be tike a topographical 
map, the total surface area is calculated by adding up the 
tops of each region and the sides of each pixel. It is thought 
that greater brightness of a region indicates greater height. 
One bright pixel having a pixel value, under conditions in 
which there are no pixels in its perimeter, has a surface 
region that is given by (pixel width * pixel height + 2 * pixel 
width (pixel value) + 2 x pixel height (pixel value). (There 
are pixel width, pixel height and pixel value.) Here, pixel 
width and pixel height are, respectively, the distances 
between pixels in the x direction and the y direction. This 
method is described in detail in "Fractal Texture Features 
Based on Optical Density Surface Area" by Calum 
MacAulay and Branko Palcic in Analytical and Quantitative 
Cytology and Histology, Vol. 12, No. 6, December 1990. 

[0039] Another method for evaluating the severity of 
the skin as a whole that is known to those in this industry is 
texture determination using fractals (fractal texture 
measurement). Fractal dimensions are characterized by the 
manner of surface change when determinations are made at 
different resolutions. Fractal texture is calculated by [the 
formula] 2 + ((log 10 (surface region - log, 0 (3x3 surface 
region))/logio(2)). Here, the surface region is estimated by 
the surface region of the image or sub-image and the 3 * 3 
surface region is estimated by a surface region of a 
resolution in the vicinity of 3 * 3. This method is described 
in detail in "Fractal Texture Features Based on Optical 
Density Surface Area" by Calum MacAulay and Branko 
Palcic in Analytical and Quantitative Cytology and 
Histology, Vol. 12, No. 6, December 1990 and in "Multiple 
Resolution Texture Analysis and Classification" by Peleg, 
Shmuel, et al. in IEEET Transactions on Pattern Analysis 
and Machine Intelligence, Vol. PAMI-6, No. 4, July 1984. 

[0040] Another method that is known to those in the 
industry as a method for evaluating severity of the skin is 



pixel intensity variance. A region of rough skin is 
typically constituted of bright pixels and dark pixels 
and leads people to a sensation of an uneven skin tone. 
Pixel intensity variance is calculated for either some or 
all of the pixels in an image or sub-image. Variance 
increases as skin becomes rougher. Often, a lighting 
gradient is present in the image or sub-image. In such 
a case, attention is paid to unevenness of lighting 
rather than to unevenness of the skin in the calculation 
of variance. Erroneous results that are produced by 
the lighting gradient can be processed by at least two 
methods. The first method is a method that uses a 
known technology called background correction for the 
purpose of removing the lighting gradient when the 
lighting gradient is a known value that is fixed (for 
example, when the imaging unit makes corrections 
using a flat monotone surface). The second method is 
a method in which variance in a localized region of the 
image in which the lighting gradient is small or can be 
disregarded is calculated. For example, a sub-region 
of 2 1 x 2 1 pixels having one pixel in the image that is 
to be analyzed at the center is used and the variance in 
this sub-region is written into an identical 
corresponding pixel in the original image. A variance 
image is made by repeating this processing for multiple 
pixels in the original image. The average intensity of 
the variance image is an accurate estimate of the 
localized variance. 

[0041] Results of display analysis 
Once the image has been analyzed, the results of 
the analysis are output. The output of the image 
includes the computer output of any type of computer. 
For example, the image transmitted through the 
network 222 is displayed by the printer 1 12 and/or by 
one or more than one of the other displays 108 and 
1 1 4. Figure 9 is a flow chart that displays in detail the 
content of processing 308 (see Figure 3) which is 
based on the concept of this invention. The processing 
content that is executed by the arithmetic unit 106 for 
the purpose of display of the results of analysis is 
shown. Here, each processing step is performed by the 
controller 200. The program 308 is made so that it can 
select for viewing an image different from the image 
prepared in step 806 for the operator or the person 
performing the analysis. Further, the program is made 
so that it can select for viewing the various degrees of 
severity and percentiles that have been calculated in 
program 306 for the operator or the person performing 
the analysis. 

[0042] In step 902, in which the program starts, 
the operator selects the display and the type of defect 
for diagnosis. Selection is performed using the input 
unit 212 and the type of defect is selected from the tab 
bar 502 that is installed along the top of the display 
108. In this example, four types, texture 508, wrinkles 
5 10, pores 5 12 and liver spots 514 (see Figure 1 1) are 
selected by the tab bar and the four types of defect are 
analyzed. Once selection has been made, in step 904, 
the controller 200 displays the image that visually 
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controller 200 and the display 108 produce a simulated the sunounding skin. On the other hand when the 

image that improves and/or worsens the defect region, control is slid to the left, the effect of worsening the 

Simulated worsening serves to show tiie person who has been image can be obtained. When the toggle simulation 

analyzed what will happen if the individual does not follow button 1604 is used, the operator and or user can 

the preventive plan when the operator recommends a replace the original digital image 5 18 with an improved 

treatment using ;a product for preventing deterioration of the or worsened digital image. When display of the 

skia Simulated improvement serves to show the person that original digital image 5 8 1 and the improved digital 

has been analyzed the potential benefits of a product when image is repeated, the degree of understanding of the 

the operator has recommended using a product for hiding person with respect to the improvement due to 
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simulation will be increased. 

[0050] An individual familiar with this industry will 
understand immediately the system and method of skin 
analysis that is provided. The system based on the concept 
of this invention can immediately identify defects of the skin 
in a user friendly manner, and, as a result, the operator can 
recommend a cosmetic product and/or medical treatment and 
can also simulate improvement and/or worsening of the skin. 

[005 1J The description presented above was prepared 
as examples and explanation and the scope of this invention 
is not intentionally outside of or limited to the modes 
described above. In the light of the concept or the concepts 
described above, many changes and modifications could be 
made. However, the scope of this invention is not limited by 
the detailed description but, rather, is defined as described in 
the claims. 

[Brief Explanations of the Figures] 

[Figure 1] This is a block diagram that shows an 
imaging unit with which this invention can be realized. 

[Figure 2] This is a block diagram that shows the 
arithmetic unit shown in Figure 1 in greater detail. 

[Figure 3] This is a flow chart based on the concept of 
this invention that shows the details of the processing that is 
executed by the operator and the arithmetic unit shown in 
Figure 2 for the purpose of analyzing and displaying images. 

[Figure 4] This is a flow chart based on the concept of 
this invention that shows the details of processing for the 
purpose of obtaining images. 

[Figure 5] This is a diagram based on the concept of 
this invention that shows the graphical user interface that is 
executed by the arithmetic unit shown in Figure 1 and the 
display for the purpose of displaying images that are 
obtained. 

[Figure 6] This is a flow chart based on the concept of 
this invention that shows the details of the processing that is 
executed by the arithmetic unit shown in Figure 2 for the 
purpose of evaluating sub-images. 

[Figure 7] This is a diagram based on the concept of 
this invention that shows the graphical user interface that is 
executed by the arithmetic unit shown in Figure 1 and the 
display for the purpose of displaying the position of the sub- 
image. 

[Figure 8] This is a detailed flow chart based on the 
concept of this invention that shows the details of the 
processing that the arithmetic unit shown in Figure 2 
executes for the purpose of analyzing sub-images, evaluating 
the position of the defect region and comparing the severity 
of the defect region with the average severity of the skin of 
a population of people. 



[Figure 9] This is a detailed flow chart based on 
the concept of this invention that shows the details of 
the processing that the arithmetic unit shown in Figure 
2 executed for the purpose of displaying the results of 
analysis. 

[Figure 10] This is a diagram based on the 
concept of this invention that shows the graphical user 
interface that is executed by the arithmetic unit shown 
in Figure 1 and the display for the purpose of 
graphically comparing the severity of the skin with the 
average severity of the skin of a population of people. 

[Figure 11] This is a diagram that shows the 
graphical user interface that is executed by the 
arithmetic unit shown in Figure 1 and the display for 
the purpose of displaying the position of multiple 
defects. 

[Figure 12] This is a diagram that shows the 
graphical user interface that is executed by the 
arithmetic unit shown in Figure 1 and the display for 
the purpose of displaying the position of multiple 
defects. 

[Figure 13] This is a diagram that shows the 
graphical user interface that is executed by the 
arithmetic unit shown in Figure 1 and the display for 
the purpose of displaying the position of multiple 
defects. 

[Figure 14] This is a diagram that shows the 
graphical user interface that is executed by the 
arithmetic unit shown in Figure 1 and the display for 
the purpose of displaying the position of multiple 
defects. 

[Figure 15] This is a flow chart based on the 
concept of this invention that shows the details of the 
processing that is executed by the arithmetic unit 
shown in Figure 2 for the purpose of simulated display 
or actual display of improvement of the defect region. 

[Figure 16] This is a flow chart that shows the 
details of the processing that is executed by the 
arithmetic unit shown in Figure 1 and the display for 
the purpose of simulated display of defect regions that 
have been improved or worsened. 

[TRANSLATOR'S NOTE: 

Figures have been inserted in the order in which 
they appear in the text, which is not their 
numerical order. The page on which they appear 
will be indicated and the items in the figures will 
be presented in the same relative positions in 
which they appear in the given figure together 
with the number codes when applicable. ] 
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easily locate 
areas visually 
cosmetics and 



BE SOLVED: To 
multiple defective 
so that suitable 
medicines can be 
selected by electronicaDy changing 
the colors of multiple pixels in an 

-1- 



area containing defective skin points 
into at least one color which is 
contrast to a skin color of the first 
digital image. 

SOLUTION: An operation device 106 
is connected with an imaging device 
104 provided with a positioning 
device 116, a light 118, and a 
digital image generator 120 such as 
a digital camera, video camera, etc., 



and also connected with output 
devices such as a display 108, 114, 
a printer 112, etc. When diagnosing 
a skin, the first image of a human 
face is obtained, corners of an eye, 
nose, mouth are specified as a 
reference, and based on these 
references, a sub- image is 
electronically defined. The 
sub-image is electronically analyzed 
to locate multiple defective areas, 
and based on the first digital image 
of the human face and the defective 
areas, a second digital image is 
created. 
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jmnmzwfct&tMzmizm 1 t^/m ^-x^ 

zix^&ixhmLnvt^jvn&zmtZithztiz 

t M^<7)ffl ^ScT V ^^2fy7iW^-y^Ml, 

^ xr m ^iidiinem 2 r vtw * -iszm. 
^2&&3>hv-yb*ffitz>A<7)mizm-*z>im0) 

CI9^3 9 3 A<omtiS&W£{4gfca6#&£ 
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[ifl$«4 1 3 M)WWm 1 fy^/W ^-^SrlW* 

mi em 2 w^a- 4 ^ - r < *r v * uzm^h 
[ooo 13 

mzm?&im£&*i-t>%m&vi]mizmt$> 
hh. mz. AfsnwoTitfMt-Mzmtzi* 

[0002] 

[t£fc<Oftffi] £1Sfl^«fcA,ir<0AHHi* ma** 

££SI*U ZlXtt:, &£<7)mLmftb&££{t't 
[0003] A^ti\M^fj ^y^t'a-f 4 -ti*? 

y-t 7 (Beauty counsel or) tt, )K^E^XB6£Jl#tf 



[00043 

(0£o%tiVy*Mi±®W%i><7)T'b t ) . -r^T<0t* 
5TC£6;birm3:V^ ^ffir(counsel)<7)^i. 
££fc9D6iOT£>£. x^y-ty 

tfjLT^m<o™zmziz&jLh<oitm&v*> r ). k 

[0005] 

zbcox-z h-mmf^mzmth. 

[0006] 1 ^><7)^ti. *«W<0x^A 

T'#&,Ii:T'*>l>. *%0J^XrAtiAo®^liO 

PSIS^tm 1 WfVtiM 0 9*3 »<> 

#^Pfi^«li^=5r<ttlo^Btc^4E 

m j*-ist,zm^xA<vffi&v%$m®<o(m£^°* 

I»<^< k {, l mmzttFmiz%lhZb 
[0007] *fcBJJ<0ffi<0tfftli, *^C0^xAli 

ty^fAii mkco&smzm^x, wm&m 

[0008] *^Bflc7)$ hlCm<0mHt. *%ffir>isA 



oimizm-ji vtraw^ 2<otx*/m 
j m&<n&«\,zn~rhimzi{j'z (bzwmtuz) 

t o o o 9 j *m\n±Mcomk*mijfi*, mmz$ 
mcomi-mmmizmm%mmz%?h%iz 

[00 10] 

*-yy rmwii'i^&gtxm&t *7V9 mm s tix 

OeiZim^fltz^M-^y^mm(iaasing rig) 1 o 
#$izto\£X0M0M&4 *—i?>mo\\TWR 1>X 

xmcomt&miftwizmmnmmz 
too i 1 3 ^^-yy^aio4ii. fss^^s 

116, 7^f M 1 8fcJ:i;fyW^-yyx^^ 
?12 0{*. T^I^&® 

iz. Kwzm%nm^m%<7m&£toxxmizti 

1 1 6^ 4 *-iStme>&&bW>&&0yJr&< 1 1» 

i ^-m^u £$ts£otzi-h tztbv&mx-b h . d 
[0012] mnmm o 6«, mmmiT^xyu 



(6) #$§200 1-4 1 9 (P 200 1-4 1 9 A) 

io8t»2r-r^7 , w i i4aw;/*fci4ryy 

*1 1 2Jfiriftf)l^LlJ2U:tf5aj*«t«tt$ii 
^#^^108, 1 14£:LTte, HHf 
(CRT), »flf^ri/>f (LCD)i^ii-e^iJ^^cT) 

—frvyfi^ 4y?i/xvhTVy?ttz&*<wifr 

<V&$<7)7Vyf*m*tltt£\\ r<XT\s4 10 
8, 1 14tt*^-^«S*4IW)-f>-^ JMff 
ft* lWWfx7M^-y^^f4, ffig 

Wt^ruv^ 1 1 2ii, M^ffofeAtf^' 

[ 0 0 1 3 ] S2te s 8tg$gR 1 0 6 £ J: mmiZTFit 

3vea-*-cajurj:<, ifcii, dm%si 0 6 
hmzb~>xmxb^x, *m&m&.v/*tzi± 

§Sffi£r£trr& i b <?>X'% ZftfecoTTV 1r-is 3 y£ 
S (application specific device) X'fotli$£^^ 0 

mm 1 06^nyhn-7 2 0 Oii, Mltf?yyj*T 

U 2 0 2. Witfy - y y (rom)& 
£'<7)rn^io<qE'j2 04. v ^^ nrD ^ 

«y^2 0 6$:ili. s .1 filter-* A* 2 0 8i,zX^X 
fflfa%tl& ^ ^CTii, Tni/^A^<^U2 0 4ii. $ 

?yt*-??u7y^n*mzimLx&*). ^ 

Tu^yMtU 9uTu±v*r2 0 6t*J: iXmfZ 
til. To^7A^tli204lt «itfA-KH9-f 

tfzii. %&&izbr>xUW%7T-J>*7xTlzf>tt>u 

[0014] Affi^(I/O)0K2 1 OJiHRWfciMfi 

3yhD-7200^IW^7 h?~? (optional 
network)222 (0Hx.<?n-^xy T^«y hV-^, 

4y?-*vh%b*) <7>£oZffi{i+*y*Mz®&L 

Tv>S, *y h 1 7-^2 2 2{i. OTTSK**yifcJfl 

-K, v»>^<0J: ■3=SrA*»IB2 1 2 

14, 5>f>'2 14MtTI/D@||2 10(CftttSiir 

-fxrw-f 10 8. 1 14liI/D0H2 1Ofca&tt$*i 
?tT-^S:^WCa^f Sfe^tc, 7^y218Srii 
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[00153 *&mzx &&mco$m 

x-te. mnsmi oeizx^xTnyj&itztitiwm 

ii. aybn-7 200lz£->xmfi2tli>* !m30 

777304) . ZM<ffimtotfLXm0>&te 
Ur*y 7*3 06) , XffimmZ$><V>Mpot>u\ 
ation of people)«IOTW/tlt^*^^ll^ 
&*3*~?bftMtt* Ur»y73 0 6) . *IX# 

CKf/Mt5 (^f773 10). <rfl*>c0#*x 

[00 1 63 >M-s;0flRft 

0 2 (03#fi§) «W«fc»lift»r7n-^-hr 

^3&^ws*i&a^o»^ mum) *4*-&>im 

I104rt«mf774023!) l ^S. Mi 
«*>f^-^SrWW&fc*fc. +^*>o^-«p(sirffi 
cient and consi stent) #«9fiBI*3&*#B"C& & . *T-y 
7'4 0 4ftlf4 0 6f«. -f^-yOMfcfiftC-f* 
fci&fc, AaHO<«£fc5SLfc«fc* 94 M 1 8* 

fi/W>-^x4i/-;i2o 

aw&fcftfc, m<?>m.Z)kfe*$>mz7j hiist 
jx-f&s&mi 2omm&&feLxi>£\\ 

[00 1 73 74 M 18. fyW-X-yVx^U 
-?1 20to£VU<r>tiLn&&*r>t:b, X^rvTAO 
STltt^s-tWvyYlzfttXIf&timth. 
^f774 1 OT'ii^^&T^S^T^^/Mb^n 

& (fip*>2mstw^^^$n^) . mk^xy-^v 

74 l 2T'tf. ri^;M*-^T-*tt8«SEl 0 

tzi>tz<ZA,h*). zix^im^&miizt^xm 
x&z. ma. mztihAtf*vh7-?2 2 2* 

{fit. T^u^^Srr^Mtrf* 

[00 1 83 y^-7x>fX 
H5te. *m<OM&£X0m$lM 

fc^Sl Oefcil/fbSISHl 0 8fcJ:-? 

m*£7jk?mxh&. ®ia^Sl0 8tcJ:oT« 
S2&^£S1 1 4t,z£'oXi>&J8.tZ> 



zttfxz. nxv/ztM. rv>*i i 2x^m 

hZthX'Zh. ®5tZ7fi-fi?y7<*jl>3--'¥4>? 
-7x4*ti, fU7M 1 0 8^0±SU;:*H.-cm{t 
^i^£;?7>'^-502£{^§;i6. ^P-^OSfNffl 
(operator controls) 5 0 3 &T 4 XTVA 1 0 8tf)2E 

AOH5 i 8^sm£;ft^4*-:^^$*vc 

[0019) tm*7*U4I^1 0 8*;:J:-?T£j£S*t 

mhzttfx-zh. mz. z<omx'\t. »k*7W 

(508-5 14) <7)®mZ$&i+&t:#>. ttz.mt 
l>^^liKf^^Ul/-i/3>5 1 60&££^ 

A#Afi§S§2 1 2*mvZ4^<nmX*97'rt-5 0 

^n^a^^07. 01 0-14&1/I31 6£ 

[00203 *^U-*2^/*fcli#tfS*t*AUU 
A#£M2 1 22HW^U-*a«f«HfcJflVvCT-- 

^(coinmand)-f6. £tf>WTtt> A^HteA^-fS^O 
Cf *X hfflftext box) 5 2 0#W2&tfrCfc£o A^ 

2 0 2*»4>Wffi"«5W«(F?(identIfier) 

5 2 2<ca*$*i*. ^aja&ftrii. A<#wwi, 

7*-?) fcitlWftRC«II»«rjW«IRt:fflv^fcW 

Wftxhh. 

[00213 zcmv>*^u-?comm&mb lxu, 

r|WWj^>'5 24, r 7 ^j^y526, 
^7-f^3yhn-/P528, jf»fxy;«530, 
i^J:^ #?y5 3 2#&&. ^S^^y5 

24li. ±j^Uc (04T.T-vr4O8#^) 

mmzftoziyvx-mmuzmizith. 

?X?y526\£V74X-i' (03cO7.-r 773 04 

}i> 5 2 8 ti 1 ^ 1 1 JSLhWr-f * - ( PWtCOV ^ 

3 0ti. tt«?5:flJl<o#ttov^ (Wttf. £#><textu 
re), lb. ?L, fcil/Z^^li. L*) *%^f$ns 

-rz. mx*y532\±mtmzm(*h msn 

^^7-3 0 6&l^8#M) . 
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[00 2 23 WAt-Wftfe 

&o £^2gffi^JB£*$lvt(I n one embodiment). # 
WUx >y ran v h 0-7 2 0 0 fc J: *-> Xfthtl h . 
*rVA*-V\*. 9mtffttotl&W&4 1 8<9 
4W»fc*KvcKf(K.x-$>5 l 8<0- 

100 233 «US30 4**tt44^r«y7'602 , CW. 

«. ZZXli. *^-*#A2l§3lE2 1 2*fflHT 

~^^$rnyNn-7200tCfi : i5'ltT^^< s d 
^ J: o 

bimfeammzTm^x^ztteizit, ayhv-? 
200 tfzmtzx *-VQ®tekWRth , 

[0024 3 *-V<tf$£fflm$fl 

ht. XTvT6 0 6x-itmmm*Miis&9m<o^ 

ii^U-^;&«A^E2 1 2^v^,ri:t;i:oTfi : 

3. &wmimmti&b, ^7/622^^ 

T, ^U-^tiA^JIS2 1 2bm*Ztitz'l*->> 
5 1 8£jflwc, 4M3ItfO*SW^>f^-^|&W7 0 
4 <07#B&) £ffi< 0 S5S«^|^HR$n^^^ 
tt, 3yhP-7200ii. ^U-^Mfl/C-f*- 
^ 5 1 8±fc^£fi*:HH<7)gEP7 0 2£3IiR£i*£ 

t) . Xf7 7*6 2 OTii, A^S2 
1 2t^$fi£>M-y5 1 8*Jfltvcfr7W.x--i; 
OfcftO*BW7 0 2 (®7#fl3) *&ttoartt"CW? 
^^T. 3yhn-7200iig93702$-^ 

LW4>44*wnJSrttwr-f x-vomm o 4 £«i 

[00 2 53 S»K:J:*^>f^->?<0^3Wa»5$tL 



h b . XfyT 6 0 4 T*ti£ii&£fctt¥Siil(seai-au 

igiKtfA2j£g2 1 2^ffl^T5f^U-^t:J:oTff*> 

Xf 776 1 2T1i*^U-?#A*!£B2 1 2£ 
ffl V ^T^]^^T'^7 , >r * -yofc^Hft?) S EP 7 

Tc7)gEP7 0 2MtRf*£Wi*^. *T-yT6 1 4 
St^6 16fii, ayhp-7200(i, 
A^Ufei937 0 2^Eff^aEPxyru-b (ffil^if 
8t$*?X?) fcJHSU 3i-^-^A*LfcBW7 0 
2£&ft<7)&3l£7/I^UXA (shape warping algorit 

hi)*fflv^resaw-&ck(cj:o, ^o^een70 2^ 

a»Wt»s€t4. fl*fcf, BI9<9geP7 0 2ii. 
W-*WJjU:#BG]7 0 2fc. Cil^^gE|J7 0 2 

tciortf^itiifiv^ -eur. aOcOgEP702 
ii. SfSIWt^=S:&^^h;K?52»:ffiitS*iISIt. 
-?l;:£oTA:ft£il£2-O<9@eP7 0 2<7)x. yJ^M 

-7200ii. @EP702 (3T^U-^*<A*LfcBW 
7 0 2 b !»W£ftJ£S*lfcB8J7 0 2<7)M^T) $-^1 

o*m<. 

[00263 ^gi&tc X *-&«M&mRtS 
flhb. Ztv76 0 8X1*. fyW-X~y5 18 

3yhn-7200 ^T'^ ^ - WtHtW-tKX <r> S 
ffl7 0 2^*St&. Z«nmv%fm5L9tVZ>T)l3 

Z??th%\iZb~>X&*nX'*>h. *<7)£o%T>l<zfyX 
AiOlOte, ^Proceedings of the 1998 IEEE Inter 
national Conference on Image Processing, WA05.03.C 
hi cago, October 1998£&$£;h.*;M.Lievin, F.Luthon, 
O'Xip Features Automatic Extraction"(Cptl\ & 

znxMtemxmb ixuixbz. 

[0 02 7 3 -tett/4*~&mx&Mb* * 

<IT1i, nyhn-5 2 0 0tCi:oT. 2o<?)gHP7 0 
20RKcAllamM., B^TW^^-xiO|&?P7 
0 6 (H7Sflg) *«»Jg$ft&. ^x«yr6 2 4T'ii. 
^W~^^X7-f^3>hD-;l,5 28^^frn.^ 

fflltf. XyAy^yhn-)U5 28^^zmf)^t 

(increased). ttiXyj bn- ;l/5 2 8££fc: 
i&*^{f. ^7'-<P<->''<7)ScOT^M(^h$<^l>(dec 
reased). Jd^LJtXx-yTV) 1 ^V^L 1 
XTv7tfmZtlX^%<Xt>. XTvr6 2 6(C*J 
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<. 

[0 0 283 d^ffico^Si: LTii. &&coe?*;U0 

^<9^f££itProceedings of the 1998 IEEE Inter 
national Conference on Image Processing, WA05.02,C 
hicago.October 1998(C^?iDtM.H.Yang.N.Ahuja. 
^"Detecting Human Faces in Color Images" fcffL 

i^telfcfcProceedings of the Second International 
Conference on Audio and Video-Based Person Authent 
ication (AVBPA99),Washignton DC, 3/23-3/24. 19991C 
#j|fc$;ft£:R.Herpers, G.Verghese et.al. ,<0"Detectin 
g Human Faces in Color Images"(C^pUv\ £ri3 x .1 

[0 0 2 9] t-Wfrtt 

fttfLxxv&(?>tit.m&%.i. xmm*$<cr>x<w 
^mMcon&tm*$>ft%$:*ix^z>. zzx- 

V^tbtzfrngmtjmh*) (estimation) X'h$>. W 

h. mm. mm&z&vmx-b&ih&v/t 

EO#tf>. ^(follicular pores). mtti~*\z?)£ 

ile lentigenes)^J:o^rfe^*^J^t^, #£&(nev 
ih Ztffr? (freckles). %<7>Wz< £ ^E<0£8S<7) 
MM&i « %T iVJ U X A *M V * * - 1 (rZ £ o T 

^tDiSkin Surface Analysis System and Skin Surface 
Analysis Method (Japanese Patent Document 95-23188 
3). Systems and Methods for the Multispectral Imag 
ing and Characterization of Skin Tissue (PCT Docum 
ent WO 98/37811) fcitf. Apparatus and Method for M 
onitoring Visually Accessible Surfaces of the Body 

(U.S. Patent Document 5,016,173)(C§¥U>* tcti. 
ZiXh^\imiiMtLXllLXhh. 

[ 0 0 3 0 3 m 3 0 6M*raXr ?r 8 0 2frt>tk& 
0. £i9ft(index variable) i/mSC&Zlli. mW& 



804Tte. ^>f^-^rtfcfcltS«ft^)XPS<7)^>f 

h) . *-*;mzm&6-o<?)i*.<r>imtm% 

TXfiS^fc J: (approximate center) 

[0 03 1 3 ^r-yr8 0 6rii. 3yho-7200 
UA^^TC^r^^^^^-^^XPM^^© (0 
1 l*v*LE14$r!S> izm-l^xmtzKTiSfM * 

i*-vn\zh-> tz&&nxm&mmmtzimz $ 

9***U*J:V\ ffi«)«i:UTtt. 6o<0^uL*<7><£ 
[00323 Xf7 7-808T'(;L 3yhn-7200 

*/l/#f)^f*j££ l 0%*L? 

*^L*<o^»cBW*»fi««fa«ai5 o tmfezti 

ffi$ii^?L^3 0e^-t:;P$raorv^tf. -ecOTL^ 

tfz<crmm^%h®^zimmzmt?ti&£t<\ 
mti$. tax? %%&wtnmzGm^L*m:* 

tl&£\\ 

[00 333 Xf'y7 8 1 0T'fi> nyhn-^2 0 0 
liA^cO^I^fi^S (percept ion coeficients)CS^^ . 
mtf^^SS(aggregated severity) Zmmtth (no 
rraalize). »TO^UI0fe^L 

cO^^^LT^$^SJe5:2fS^-m^<i:^. ^ 
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[00 34 3 Xf7 78 12t'll 3yhn-7ii, h 
tzmmcoSMm (percent! le) £<C0Acr> 
hie location). Aflft&Jfii^ t tzli*<7)facr>m%1,Z 

4Hfi*i 5 5 & V > L 5 6 1 m%Ztl& . 
[0035] Xf7 7"814T'ii, ayhn-7200 
te^J^^^ybU Xr>yT8 16T'te. a 

y h u-7 2 o o lijuit^^ £ o <r>$.m<r>? 4 r 

HmtfBVMLftfrtlZ. AtvT8 0 4*^81 6(0 
J^-y^O^tfzl/iz. ayhv-y2 0 0lixmco 

&mzmixm%hT>i'3vxj*t:m\ xmmmzm 
fcthmtzw *-i?*ft&LL. ^muz&^xmh 
m&tmw ^^z^m^^thmzm^^ 

i/s yf-^ (population data)£#jUTi«fc 
V> (Ml 0&V*L14#!S0 . 
[0036] tmt&XMWJ T##£L&l^K 
te, nyhn-5200ii. ^f7r8 18M^f7 

ZmtUzhObKcZ. Witt. *7^y7*8 0 8£;fc^ 

-*<i. ^LfeAoAO«fH3^v^rafiW«. 
[0037] <iA^^^M^Pf§a^omiKcS^<M 
<0^*flWrSKfc:JaiT, 1 ft^L 1 &-b<9M^#tt# 

±ftmzvmztiz>. zan.&frm&i&ytp&im* 

m&XWzhfflfLX\*%b%\\ Wttt. Mkton 

(smoothness/roughness) (DB&^&W 

mimmizwz) -^m^mtxhx 
c o o 3 8 ] M£tfr>n&zwfcf$t:#><om«%im 

Z>m\,ztnX j m<ni><r>xhbo. wt\imm®& 
wmwzdx'hz. mwmmmz. w^vtj^y 

V (pixel count) lz£ ->X #£J$ft££T^MfSi£(to 



tal surface area)<7D}$|£'C&l> e fy^/H>-^ 

mmwxoiz^i&tt&b. £.x<?>$mm&t&m. 

^c0HJ:(tops) t^t^-fe/^M®(sides) t ££f|"f 

^$ft&*>c0£::f;t_£>;fU> 6 e?-fe/HI(pixel value) 
tti-h-^<DWh\^9<tM$. mWlZVflDVtfti: 

\^kmz&^x, (e^-fe^«ixt:^-fe;i,co^$ + 2 
xtn;« (fc:?-fc/HI) +2xe;-fe;^§ 

(e?*/HI) ) lc<J:oT4^ft!)iMm$£irtS 
(&fc\ e^Hry^iKpixel-width), 
(pixel-height), e?*/HI(pixel-value)T'£>£ ) . 

^Analytical and Quantitative Cytology and Histolo 
gy, Vol.12, no. 6, December lWQlZlRMZtltzOilw Ma 
cAulay^Branko PalcictfTFractal Texture Features B 
ased on Optical Density Surface Area"(Cf¥UV^ 
[0 03 9] %mi,z4mk%^X^&fVL£ft<7)mZ 

M% (fractal texture measurement) #&!> * Vv99 
/l/T-^>-X3yX(fractal dimensions)^ W&hlfr 

mx-mz. itz t % izmmmcomtnttiiizftwitf 

foh. 77??/WC £ J:£##>(fractal texture)(i x 2 

+((i os^mmmm- 1 og 10 (3x3Mw 
i og 10 (2))T'tf^iii,. ,rc:(c. mmmmtiu 
j-isttzmrj *-v<nmmccjMi>hti. 3 
x 3 mmmt 3x3 coim^mimcommmx 

MMhhtlZ. ZVXfimt, ^Analytical and Quant 
itative Cytology and Histology, Vol.12, no. 6, Decern 
ber 1990^ie^^ix/cMacAulay, CalumtPalcic, Brank 
oCO" Fractal Texture Features Based on Optical Dens 
ity Surface Area"t. ;£iRlEEETransactions on Patte 
m Analysis and Machine Intelligence, V0L.PAMI-6.N 
0.4, July 1984£fa$£iX*:Peleg, Shmuel, et. al. 
^"Multiple Resolution Texture Analysis and Classi 
fication"£f¥LK Ztlt>$Mlim*1fttl 

xmtxbi. 

[0040] mnw&zmfcthtztbniimx'ib'ox. 
%mizt^x&%cr>zcomirmbixtt. vt&v 

^SilM(pixel intensity variance) tffo & e WxtzW, 

xm&zux&t). T^zmh-yitZAmwi&Mz 

¥ft<7^&tzli£&<7)Z7*>W^?i\lznLxm 

nx-zz. mmKzwimtfffiix^&ztiz* 

ighting gradient) Z<7)£o%ifr&(,Z\iffig: 

z*mz\tiz%$>. mzmuz x^x^tm^tz 
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^iC^rt^Kbackground correction) 
Sf$ii^^>-^OlO£7)e^-b;U$:4"i:^'f&2 1 

x2i vt&uwr&mmw twymmofc 

m^mOmt^tizXO. {Ill^-^variance imas 
C004 1]^^^m 

7-7 2 2 2£ilt:T&{i£*U T'Jy^l 1 2&tf/ 
*fctt*W2(^lfc^LlI^^*xrW 1 0 
8. 1 14fcJ:oTCJ:oT^S*U>. H9«i, *3& 
W)JU«:J:ftra^9^3 0 8 (B3#8&) Mrt 

72 0 0Ci:oTtfi5ii^. Tu^ix3 0 8ii, 
U-?2£te#ffi$ft6A£ttU\ ^f7r8 0 6(: 

[00423 7o/7«^|,Xf y 7*9 0 2 T'(i, 
r < XT W i: mfotzMzXMM 4 7 
*m*t&. WWiA*£B2 1 2^ffli^fa 
10 8cT)±^^oTlStt^il^^r>'<-5 0 2 

8. Lfc5 1 0, 7L5 1 2RV L*5 1 4 (01 1# 
S3) *>4-rt*7A-TWU 4Otf);M7'c0XR8£ 
##rt&. -&M$W%2tL&t. ^r«x 7*9 04^fe 
^T, 3yho-5200ti. ^--Cxr-rXTM 10 
8&tf/2fcte£Sfl^7MXTW (optional displa 
y)l 14£, Xf-/78 0 6 (Hi 1-14#!$) T'ft 

1t&. Xf-y7*9 2 2Tte, ^P-^tifi&^^^A- 
508, 510, 5 l2ttzli5 14£MtRtZZ\tlZ 

c o o 4 3 ] mmzimw£®f&-h't 
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m%mjm*wmi l zffistthz:tT2>*>i. mi o 

fcL !Dl<O»K*WI^)flJ:OfcT0or visits 

•yT9 0 8rtt, tf^U-^Ji, r <f X7V>f±fc<afi 
<t&3yhn-vw^y?;u 0 1 2<9ffittfJ£ rf-ff 
4/MDetailed)j *»flt*4£ t tz£ 0 . Hfttifr$OT 

0 2-101 Oity^N'-^^fifc^ft&o 
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^SSift^MV^iB (treatment) ZWh&lSLtZ. tttt 

ztifzMzm&tz x h wm&mbtth tzwzm. 
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